Running Head: VERIFICATION OF COGNITIVE ATTRIBUTES Verification of Cognitive Attributes Required to Solve the TIMSS-1999 Mathematics Items for Taiwanese Students
نویسندگان
چکیده
Educational assessment is a process of collecting evidence and interpreting it to provide instructors with information regarding students’ learning. However, the current design and scoring of most standardized educational tests are insufficient to serve this purpose. The limitation exists primarily due to the lack of cognitive information incorporated into traditional psychometric models. To date, some psychometricians have applied cognitive psychology principals to psychometric models of educational assessment data. Of these models, one of the most extensively researched and empirically supported is Tatsuoka’s rule-space methodology (RSM). RSM can be used to validate a proposed cognitive model. A list of cognitive attributes, which describe what knowledge, strategies, and processing skills the TIMSS-R mathematics test measures, was developed with RSM by using the U.S. sample. Research using these cognitive attributes of the TIMSS items appears to adequately describe student performance for several other countries. In our current study, we intended to explore how a list of cognitive attributes expresses student performance in Taiwan. Three analyses, including calculation of classification rates, multiple regression analyses, and comparisons of attribute mastery probabilities across four booklets, were conducted. Successful classification rates ranged from 99.3% to 99.9% for four booklets, and R and adjusted R for each booklet were estimated using multiple regression analyses and ranged from .943 to .979. All ranges of mean attribute probabilities across booklets were less than .25, except for the Recognize patterns attribute (S6). Generally speaking, a list of cognitive attributes and the incidence matrix used as a proposed cognitive model in the current study represent the performance of Taiwanese eighth graders on the TIMSS-1999 mathematics tests very well.
منابع مشابه
Running Heading: DIF AND RSM FOR VALIDATION A Unified Approach that Combines Differential Item Functioning with the Rule-Space Method for Validating Cognitive Attributes for the TIMSS Mathematics Items
The main goal of the rule space method is to classify examinees into the closest ideal attribute mastery patterns and to assigned appropriate attribute mastery probabilities to them based on their item response patterns. The quality of pattern classification and probability assignment depends on the validity of the proposed attributes and the Qmatrix. The rule-space method provides the quality ...
متن کاملConstructing and Validating a Q-Matrix for Cognitive Diagnostic Analysis of a Reading Comprehension Test Battery
Of paramount importance in the study of cognitive diagnostic assessment (CDA) is the absence of tests developed for small-scale diagnostic purposes. Currently, much of the research carried out has been mainly on large-scale tests, e.g., TOEFL, MELAB, IELTS, etc. Even so, formative language assessment with a focus on informing instruction and engaging in identification of student’s strengths and...
متن کاملRunning Head: SUBGROUP COMPARISONS OF MATHEMATICS PERFORMANCE Subgroup Comparisons of Taiwanese Mathematics Performance: From a Perspective of Cognitive Attributes
متن کامل
Diagnostic Assessment in Timss-r: Comparison of Eighth Graders’ Mathematics Knowledge States in the United States, Japan, and Israel
The study combines between-countries and within-country comparisons of performance on the 1999 TIMSS-R mathematics test using a probabilistic model for cognitive analysis known as "rule space" (RS) (Tatsuoka, 1983, 1995, in press). Samples of 8th graders from three countries – the United States, Japan, and Israel – were compared with respect to mean probabilities of mastering attributes of cont...
متن کاملDesigning and Developing a Test for Cognitive Competencies of the Iranian Students’ Mathematics Literacy based on PISA Studies
Since the establishment of formal education in Iran, there has always been an emphasis on the application of mathematics in real life situation. To measure students’s competencies in applying mathematics in real life situations, there is a need to design a test with this purpose. During the current decade, PISA has been conducted in various countries to measure sudents’ competencies needed for ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2006